Codes Needing Immediate Attention (Lowest Reliability)
Focus on these codes during training - they show the most
disagreement between coders:
6. Theme of the Image/Video__Negative imagery/Negative
campaigning: The image/video portrays the political opponent in a
negative light. This can happen through sharp criticism or with
humor._bin
**Agreement:
52.5% | Krippendorff α: 0.451 | 2-way splits: 5 | Units:
40
Example disagreements:-
Content
4 (2 disagreements):
Facebook
Post | DA:✓ DO:✓ E:✗ L:✗
-
Content
7 (2 disagreements):
Facebook
Post | DA:✓ DO:✓ E:✗ L:✗
-
Content
32 (2 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✓ L:✗
-
Content
35 (2 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✓ L:✗
-
Content
38 (2 disagreements):
X/Twitter
Post | DA:✓ DO:✓ E:✗ L:✗
12. Theme of the Image/Video__Events/Landscape & city
scenes: Unlike a symbolic image, people/politicians are doing something,
moving, or working (e.g., groups such as politicians, refugees, farmers,
protesters, police officers, etc.). Alternatively, a city or (natural)
landscape is shown where something is happening (e.g., forest dieback,
fire, or flooding, nuclear power plants or wind turbines)._bin
***Agreement:
60.0% | Krippendorff α: 0.164 | 2-way splits: 4 | Units:
40
Example disagreements:-
Content
1 (2 disagreements):
Facebook
Post | DA:✓ DO:✓ E:✗ L:✗
-
Content
2 (2 disagreements):
Facebook
Post | DA:✗ DO:✓ E:✓ L:✗
-
Content
22 (2 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✓ L:✗
-
Content
31 (2 disagreements):
TikTok
Video | DA:✓ DO:✓ E:✗ L:✗
-
Content
3 (1 disagreements):
Facebook
Post | DA:✗ DO:✓ E:✗ L:✗
15. People in the
Image/Video__Ordinary_people___average_citizens___ordinary_supporterse_g_individuals_as_well_as_groups_of_citizens_such_as_teachers__pensioners__students__caregivers__etc___bin
**Agreement:
62.5% | Krippendorff α: 0.595 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
22 (2 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✗ L:✓
-
Content
7 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✓ L:✗
-
Content
9 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✗ L:✓
-
Content
10 (1 disagreements):
Facebook
Post | DA:✗ DO:✓ E:✓ L:✓
-
Content
12 (1 disagreements):
Facebook
Post | DA:✓ DO:✓ E:✓ L:✗
17. Theme of the Image/Video__Positive imagery/Acclaims: The
image/video portrays past and future achievements of the
party/government in a positive light. This includes drawing a positive
balance, saying “thank you” to campaign helpers, or positively
discussing political plans/goals._bin
***Agreement:
65.0% | Krippendorff α: 0.088 | 2-way splits: 5 | Units:
40
Example disagreements:-
Content
2 (2 disagreements):
Facebook
Post | DA:✓ DO:✓ E:✗ L:✗
-
Content
3 (2 disagreements):
Facebook
Post | DA:✓ DO:✓ E:✗ L:✗
-
Content
5 (2 disagreements):
Facebook
Post | DA:✗ DO:✓ E:✓ L:✗
-
Content
16 (2 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✗ L:✓
-
Content
19 (2 disagreements):
Instagram
Post | DA:✓ DO:✓ E:✗ L:✗
23. People in the
Image/Video___Members_of__minoritiese_g_refugeesLGBTQ_people_with_disabilities__Jewish_people__women__when_women_are_explicitly_labeled__depicted__or_referred_to_as_a_minority__bin
**Agreement:
70.0% | Krippendorff α: 0.553 | 2-way splits: 4 | Units:
40
Example disagreements:-
Content
22 (2 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✓ L:✗
-
Content
26 (2 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✓ L:✗
-
Content
27 (2 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✓ L:✗
-
Content
33 (2 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✓
-
Content
7 (1 disagreements):
Facebook
Post | DA:✓ DO:✓ E:✓ L:✗
28. Target of Attack__Dutch government, ministries, parliament,
and courts (ALSO KABINET SCHOOF)_bin
***Agreement:
87.5% | Krippendorff α: -0.030 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
4 (1 disagreements):
Facebook
Post | DA:✓ DO:✗ E:✗ L:✗
-
Content
9 (1 disagreements):
Facebook
Post | DA:✗ DO:✓ E:✗ L:✗
-
Content
6 (1 disagreements):
Facebook
Post | DA:✓ DO:✗ E:✗ L:✗
-
Content
18 (1 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✗ L:✗
35. People in the
Image/Video__Illegal_actors__criminals__offenders__terrorists__extremists___extremist_groups__Actors_who_commit_generally_criminally_relevant_actions_without_being_associated_with_a_specific_party__business___non_terrorist__organization__or__non_extremist__social_movementplease_code_them_accordingly_actors_who_plan_and_carry_out_criminal_activities_in_a_structured_group__actors_who_use_violence_bin
***Agreement:
92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
10 (1 disagreements):
Facebook
Post | DA:✓ DO:✗ E:✗ L:✗
-
Content
24 (1 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✗ L:✗
-
Content
40 (1 disagreements):
Instagram
Post | DO:✓ E:✗ L:✗
36. Theme of the Image/Video__Image from a campaign
event_bin
***Agreement:
92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
2 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✓ L:✗
-
Content
13 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✓ L:✗
-
Content
26 (1 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✗ L:✗
37. Theme of the Image/Video__Everyday politics_bin
***Agreement:
92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
9 (1 disagreements):
Facebook
Post | DA:✗ DO:✓ E:✗ L:✗
-
Content
14 (1 disagreements):
Facebook
Post | DA:✓ DO:✗ E:✗ L:✗
-
Content
35 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
38. Actors__News media and their journalists /
representatives_bin
***Agreement:
92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
5 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✗ L:✓
-
Content
16 (1 disagreements):
Instagram
Post | DA:✗ DO:✗ E:✓ L:✗
-
Content
32 (1 disagreements):
TikTok
Video | DA:✗ DO:✗ E:✗ L:✓
39. Actors__(Representatives of) non-political
institutions_bin
***Agreement:
92.5% | Krippendorff α: 0.147 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
35 (2 disagreements):
TikTok
Video | DA:✗ DO:✗ E:✓ L:✓
-
Content
31 (1 disagreements):
TikTok
Video | DA:✗ DO:✗ E:✗ L:✓
-
Content
37 (1 disagreements):
X/Twitter
Post | DA:✗ DO:✗ E:✓ L:✗
40. Target of Attack__Illegal actors, criminals, offenders,
terrorists, extremists / extremist groups_bin
***Agreement:
92.5% | Krippendorff α: 0.147 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
4 (1 disagreements):
Facebook
Post | DA:✓ DO:✗ E:✗ L:✗
-
Content
16 (1 disagreements):
Instagram
Post | DA:✗ DO:✗ E:✗ L:✓
41. Actors__Illegal actors, criminals, offenders, terrorists,
extremists / extremist groups_bin
***Agreement:
92.5% | Krippendorff α: 0.382 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
24 (1 disagreements):
Instagram
Post | DA:✓ DO:✓ E:✗ L:✓
-
Content
28 (1 disagreements):
Instagram
Post | DA:✗ DO:✗ E:✗ L:✓
-
Content
40 (1 disagreements):
Instagram
Post | DO:✓ E:✗ L:✗
42. Target of Attack__Europe/EU/NATO, EU/NATO institutions and
bodies & their representatives_bin
***Agreement:
95.0% | Krippendorff α: -0.011 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
1 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✓ L:✗
-
Content
8 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✓ L:✗
43. People in the
Image/Video__Representatives_of_social_movementse_g_Fridays_for_Future__Identitarian_Movement__QAnon___MeToo_movement__bin
***Agreement:
95.0% | Krippendorff α: 0.209 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
26 (2 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✓ L:✗
-
Content
28 (1 disagreements):
Instagram
Post | DA:✗ DO:✗ E:✓ L:✗
44. Actors__(Representatives of) social movements_bin
**Agreement:
95.0% | Krippendorff α: 0.488 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
26 (1 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✓ L:✓
-
Content
28 (1 disagreements):
Instagram
Post | DA:✗ DO:✗ E:✓ L:✗
45. Target of Attack__PVV_bin
*Agreement:
95.0% | Krippendorff α: 0.654 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
34 (1 disagreements):
TikTok
Video | DA:✓ DO:✓ E:✓ L:✗
-
Content
35 (1 disagreements):
TikTok
Video | DA:✓ DO:✓ E:✓ L:✗
46. Target of Attack__PVV: Geert Wilders_bin
*Agreement:
95.0% | Krippendorff α: 0.654 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
34 (1 disagreements):
TikTok
Video | DA:✓ DO:✓ E:✓ L:✗
-
Content
35 (1 disagreements):
TikTok
Video | DA:✓ DO:✓ E:✓ L:✗
47. People in the
Image/Video__GL_PvdA__Esmah_Lahlah_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
48. People in the
Image/Video__GL_PvdA__Jesse_Klaver_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
49. People in the
Image/Video__GL_PvdA__Marjolein_Moorman_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
50. People in the Image/Video__GL_PvdA__Mei_Li_Vos_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
51. People in the
Image/Video__Journalists__representatives_of_news_media__general__media_types__individual_media_outlets__bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
16 (1 disagreements):
Instagram
Post | DA:✗ DO:✗ E:✓ L:✗
52. Names of Actors__Pim_Fortuyn_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
2 (1 disagreements):
Facebook
Post | DA:✓ DO:✗ E:✗ L:✗
53. Names of Actors__Douwe_bob_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
19 (1 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✗ L:✗
54. Names of Actors__Security_guard_Geert_Wilders_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
2 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✓ L:✗
55. Names of Actors__Depicted_as_politicians_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
35 (1 disagreements):
TikTok
Video | DA:✗ DO:✗ E:✓ L:✗
56. Names of Actors__not_real_people_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
35 (1 disagreements):
TikTok
Video | DA:✗ DO:✗ E:✓ L:✗
57. Theme of the Image/Video__Media work (incl. TV
debate)_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
35 (1 disagreements):
TikTok
Video | DA:✓ DO:✗ E:✗ L:✗
58. Actors__GL-PvdA: Esmah Lahlah_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
59. Actors__GL-PvdA: Jesse Klaver_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
60. Actors__GL-PvdA: Marjolein Moorman_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
61. Actors__GL-PvdA: Mei Li Vos_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✗ L:✗
62. Target of Attack__Ordinary people / average citizens /
ordinary supporters_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
40 (1 disagreements):
Instagram
Post | DO:✗ E:✗ L:✓
63. Target of Attack__Foreign politicians or parties and/or
foreign governments, foreign parliaments_bin
***
Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
64. AI Labeling in Image/Video_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
32 (1 disagreements):
TikTok
Video | DA:✗ DO:✗ E:✓ L:✗
65. Topics__education_and_culture_bin
***Agreement:
97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
10 (1 disagreements):
Facebook
Post | DA:✗ DO:✗ E:✗ L:✓
66. People in the
Image/Video__Foreign_politicians__ALL_EXCEPT_from_EU__UN__NATO__bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
33 (2 disagreements):
TikTok
Video | DA:✓ DO:✓ E:✗ L:✗
67. People in the
Image/Video__Foreign_politicians_from_EU__UN__NATO_bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
33 (2 disagreements):
TikTok
Video | DA:✗ DO:✗ E:✓ L:✓
68. People in the
Image/Video__Celebrities_and_or_opinion_leaderse_g_actors__sports_figures_athletes__musicians__economists__social_media_influencers__bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
19 (2 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✓ L:✗
69. Names of Actors__Douwe_Bob_bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
19 (2 disagreements):
Instagram
Post | DA:✗ DO:✗ E:✓ L:✓
70. Theme of the Image/Video__Individual voter
contact_bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
16 (2 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✓ L:✗
71. Actors__(Representatives of) interest groups,
NGOs_bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
37 (2 disagreements):
X/Twitter
Post | DA:✗ DO:✗ E:✓ L:✓
72. Target of Attack__Celebrities and/or opinion
leaders_bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units:
40
Example disagreements:-
Content
19 (2 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✓ L:✗
73. Target of Acclaim__VVD_bin
***
Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units: 40
74. Target of Acclaim__(Representatives of) social
movements_bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
26 (2 disagreements):
Instagram
Post | DA:✓ DO:✗ E:✗ L:✓
75. Topics__labor_and_social_issues_bin
***Agreement:
97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
39 (2 disagreements):
Facebook
Post | DO:✓ E:✓ L:✗
76. Names of Actors__Donald_Trump_bin
*Agreement:
97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
33 (1 disagreements):
TikTok
Video | DA:✓ DO:✗ E:✓ L:✓
77. Names of Actors__Bob_bin
*Agreement:
97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
19 (1 disagreements):
Instagram
Post | DA:✗ DO:✓ E:✓ L:✓
78. Actors__Celebrities and/or opinion leaders_bin
*Agreement:
97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
19 (1 disagreements):
Instagram
Post | DA:✓ DO:✓ E:✓ L:✗
79. Target of Attack__D66_bin
*Agreement:
97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
32 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✓ L:✓
80. Target of Attack__D66: Rob Jetten_bin
*Agreement:
97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units:
40
Example disagreements:-
Content
32 (1 disagreements):
TikTok
Video | DA:✗ DO:✓ E:✓ L:✓